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(54) Title: COLOR IMAGE SEGMENTATION METHOD 
(57) Abstract 

A color image segmentation method is provided. The 
color image segmentation method includes the steps of. (a) 
calculating a predetermined value representing the degree of 
difference form the color of peripheral pixels by using pixel 
values of an input image; (b) obtaining a converted image by 
converting a calculated value into a value of a predetermined 
scale; and (c) segmenting the converted image. According 
to the color image segmentation method, a robust and an 
automatic segmentation is possible, and a segmentation speed 
is high even when segmenting an image containing much noise. 
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COLOR IMAGE SEGMENTATION METHOD 

Technical Field 

The present invention relates to a color image segmentation method, 
5 and more particularly, to a color image segmentation method for segmenting 
a color image. 

Background Art 

The segmentation of a color image is a very important part of digital 
10 image processing and its applications. Conventional color image 
segmentation methods have a problem in that it is not easy to segment a color 
image containing texture. Also, another conventional color image 
segmentation method for performing an automatic segmentation is not robust 
with respect to an input image containing noise, and still another conventional 
is color image segmentation method for again segmenting the image which a 
user segments preparatorily is robust with respect to an input image 
containing noise, but an automatic segmentation is not performed, therefore, 
it takes much time. 

20 Disclosure of the Invention 

To solve the above problems, it is an object of the present invention to 

provide a color image segmentation method capable of automatically 

segmenting a color image containing texture and being robust with respect to 

an input image containing noise. 
25 It is another object of the present invention is to provide a color image 

processing method containing the color image segmentation method. 

It is still another object of the present invention is to provide a medium 

in which a computer program performing the color image segmentation 

method is stored. 

30 Accordingly, to achieve the above object, according to one aspect of 

the present invention, there is provided a color image segmentation method. 
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The color image segmentation method comprises the steps of: (a) calculating 
a predetermined value representing the degree of difference from the color of 
peripheral pixels by using pixel values of an input image; (b) obtaining a 
converted image by converting a calculated value into a value of a 
5 predetermined scale; and (c) segmenting the converted image. 

Preferably, the step (c) segments the converted image based on a 
region growing method.' 

It is preferable that the color image segmentation method, prior to the 
step (a), ra ther comprises the step of (p-a) quantizing pixel values of an 
io image into a predetermined number of representative pixel values; wherein the 
pixel values are quantized pixel values. 

The representative pixel values preferably consist of 10-20 values. 

It is preferable that the color image segmentation method, prior to the 
step (a), further comprises the steps of: (p-a-1) defining a predetermined 
is window containing a center pixel; and (p-a-2) calculating a predetermined 
value representing the degree of difference from the color of peripheral pixels 
with respect to pixels in a defined window. 

It is also preferable that the step (a) comprises the steps of: (a-1 ) 
defining a window B which is centered at a pixel p and has a size of d x d 
20 when d is a positive integer; and (a-2) classifying a pixel position Z, into a C 
number of classes when i is a number between 1 and C, and Z, is a set of all 
pixels in the window B; and (a-3) obtaining a J-value with respect to each pixel 
in a class-map as: 

j _ ^_B_ _ §T Z §E 

S iV S [V 

25 where m, is the average of positions of N f data points in class Z„ 
5 7 . = Xl|r-m» 2 andS„. = IS | . = Z|r- OTl .| 2 . 

d is preferably an integer inclusive of and between 3 and 10. 
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The predetermined scale is preferably a gray scale having values 
between 0 and 255. 

In order to achieve the above object, according to another aspect of the 
present invention, there is provided a color image segmentation method. The 

s color image segmentation method comprises the steps of: (a) quantizing pixel 
values of an image into a predetermined number of representative pixel 
values; (b) calculating a predetermined value representing the degree of 
difference from the color of pixels in a predetermined size window using 
quantized representative pixel values; (c) obtaining a converted image by 

io converting a calculated value into a value of a predetermined scale; and (d) 
segmenting the converted image using a segmentation method based on a 
rejgion growing method. 

In order to achieve another object, there is provided an object-based 
color image processing method for processing a color image according to a 

15 color image segmentation method. The color image segmentation method 
comprises the steps of: (a) calculating a predetermined value representing the 
degree of difference from the color of peripheral pixels using pixel values of 
an input image; (b) obtaining a converted image by converting a calculated 
value into a value of a predetermined scale; and (c) segmenting the converted 

20 image. 

In order to achieve still another object, there is provided a medium for 
storing program codes performing a color image segmentation method for 
segmenting a color image into a plurality of regions. The color image 
segmentation method comprises the steps of: (a) quantizing pixel values of an 

25 image into a predetermined number of representative pixel values; (b) 
calculating a predetermined value representing the degree of difference from 
the color of pixels in a predetermined size window using quantized 
representative pixel values; (c) obtaining a converted image by converting a 
calculated value into a value of a predetermined scale; and (d) segmenting the 

30 converted image using a segmentation method based on a region growing 
method. 
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Brief Description of the Drawings 

The above objects and advantages of the present invention will become 
more apparent by describing in detail a preferred embodiment thereof with 
reference to the attached drawings in which: 
5 FIG. 1 is a flowchart illustrating a color image segmentation method 

according to a preferred embodiment of the present invention; 

FIGS. 2A through 2C illustrate class-maps and J-values formed 
according to a color image segmentation method of FIG. 1 ; 

FIGS. 3A and 3B illustrate segmented class-maps; 
10 FIG. 4A illustrates one image frame of a "container" as a test image and 

a test image segmented by the color image segmentation method according 
to the present invention; 

FIG. 4B illustrates one image frame of a •'foreman 1 ' as a test image and 
a test image segmented by the color image segmentation method according 
15 to the present invention; 

FIG. 4C illustrates one image frame of a "coast" as a test image and a 
test image segmented by the color image segmentation method according to 
the present invention; 

FIG. 4D illustrates one image frame of a "flower garden" as a test image 
20 and a test image segmented by the color image segmentation method 
according to the present invention; and 

FIG. 4E illustrates one image frame of a "mother and daughter" as a 
test image and a test image segmented by the color image segmentation 
method according to the present invention. 

25 

Best mode for carrying out the Invention 

Referring to FIG. 1, which illustrates a flowchart illustrating a color 
image segmentation method according to a preferred embodiment of the 
present invention, a color image is input (step 102), and pixel values of an 
30 input image are quantized into several representative pixel values (step 1 04). 
In order to classify an image in natural scenes, the representative pixel values 
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consist of 1 0-20 values. In this embodiment, quantization is performed using 
three representative pixel values for convenience of explanation. Next, a 
class-map is formed by assigning labels corresponding to a quantized 
representative pixel values (step 106). 

s More preferably, a window centered at a pixel to be processed in an 

entire image is defined. That is, when d is a positive integer, preferably 
between 3 and 1 0, a window B which is centered at a pixel p and has a size 
of d x d, is defined. Also, an assumption is made that i is the number between 
1 and C, and Z, is a set of all the pixels in the window B. In other words, an 

io assumption is made that Z, is classified into a C number of classes. 
Preferably, the d determining the size of the window is an integer inclusive of 
and between 3 and 10. 

Also, an assumption is made that m, is the average of positions of N t 
data points in class Z, as: 

is (equation 1) 

iy i zeZi 

Also, S r and S w are defined by: 
(equation 2) 

S T = Y J \\z-m\\ 2 and 
20 (equation 3) 

i=l zeZ, 

respectively. 

Next, a J-value with respect to each pixel in a class-map is obtained 
(step 1 08). The J-value with respect to each pixel in the class-map is defined 
25 as follows: 
(equation 4) 
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j _ $b _ §t ~ $r 

The J-values obtained by equation 3 are converted into a gray scale value 
between 0 and 255, so that a gray scale image having values and capable of 
being referred to as a J-image is obtained (step 1 10). The J-image has the 
5 same form as a three-dimensional topographic map containing valleys and 
mountains that actually represent region centers and region boundaries, 
respectively. 

Lastly, the J-image is segmented based on a region growing method 
(step 112). The region growing method is known to one of ordinary skill in the 

10 art as a method used for the segmentation of a digital image, therefore, an 
explanation thereof is not given. 

FIGS. 2A through 2C illustrate class-maps and J-values formed 
according to a color image segmentation method of FIG. 1 . The J-value at the 
center pixel is 1 .720 in the class-map of FIG. 2A, and in the class-map of FIG. 

15 2B, the J-value at the center pixel is 0, and in the class-map of FIG. 2C, the 
J-value at the center pixel is obtained as 0.855. Here, like in the class-map 
of FIG. 2A, in the case where pixels represented as + located at the left of the 
center pixel, pixels represented as 0 located at the right of the center pixel, 
and pixels represented as * located at the right of the center pixel form regions 

20 most clearly, the J-value is 1.720, a relative large value. Also, like in the 
class-map of FIG. 2B, in the case where the pixels represented as +, the 
pixels represented as 0, and the pixels represented as * are uniformly 
distributed and hardly form regions, the J-value is 0. Furthermore, like in the 
class-map of FIG. 2C, in the case where the pixels represented as * located 

25 at the right of the center pixel form regions, but the pixels represented as 0 
and * hardly form regions, the J-value is 0.855. That is, the larger the J-value 
is, the more likely that the pixel is near to a region boundary, therefore, a 
segmentation based on the region growing method by using this point can be 
performed. 
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FIGS. 3A and 3B illustrate segmented class-maps. 

It is necessary to check whether a segmentation is performed well with 
respect to each region in the segmented class-maps and to represent the 
same as quantized values. For this purpose, when J k is the J-value obtained 
5 with respect to a k-region, and M k is the number of pixel points of a k-th region, 
and N is the total number of pixel points in the class-map, the averaged J- 
value is calculated as: 
(equation 5) 




io The calculated values are represented as quantized values whether a 
segmentation is performed well with respect to each region in the segmented 
class-maps or not. 

In the case of the segmented class-map shown in FIG. 3A, J is 0, on the 
other hand, in the case of the segmented class-map shown in FIG. 3B, J is 

15 0.05. That is, in the case of regions of a fixed number, especially in the case 
of better segmentation, the averaged J-value is small. This occurs because 
the region contains a few uniformly distributed color classes in the case where 
a region is well segmented. Accordingly, the averaged J-value is small. 

FIG. 4A illustrates one image frame of a "container 1 ' as a test image and 

20 a test image segmented by the color image segmentation method according 

to the present invention. Referring to FIG. 4A, J of an image before 

segmentation is 0.232, but, J of the image after segmentation is 0.071 . Also, 
it is evident that regions in the test image are well segmented. 

FIG. 4B illustrates one image frame of a "foreman" as a test image and 
25 a test image segmented by the color image segmentation method according 

to the present invention. Referring to FIG. 4B, J of an image before 

segmentation is 0.238, but J of the image after segmentation is 0.105. Also, 
it is evident that regions in the test image are well segmented. 
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FIG. AC illustrates one image frame of a "coast" as a test image and a 
test image segmented by the color image segmentation method according to 

the present invention. Referring to FIG. 4C, J of an image before 

segmentation is 0.494, but J of the image after segmentation is 0.093. Also, 
5 it is evident that regions in the test image are well segmented. 

FIG. 4D illustrates one image frame of a 'flower garden" as a test image 
and a test image segmented by the color image segmentation method 

according to the present invention. Referring to FIG. 4D, J of an image 

before segmentation is 0.435, but J of the image after segmentation is 0.088. 
10 Also, it is evident that regions in the test image are well segmented. 

FIG. 4E illustrates one image frame of a "mother and daughter" as a 
test image and a test image segmented by the color image segmentation 

method according to the present invention. Referring to FIG. 4E, J of an 

image before segmentation is 0.438, but J of the image after segmentation 
15 is 0.061 . Also, it is evident that regions in the test image are well segmented. 

That is, as described referring to FIG. 4A through 4E, 7 of the image 
segmented by the color image segmentation method according to the present 
invention is smaller than J of the image before segmentation. 

In the above embodiment, the calculation of a specific function is 
20 explained as an example, however, this is only for explanation. The scope of 
the present invention defined in the appended claims is not limited to the 
embodiment, and it is obvious that one of ordinary skill in the art can use 
another modified function representing the degree of difference from the color 
of peripheral pixels. 

25 Furthermore, the above color image segmentation method can be 

embodied in a computer program. Codes and code segments composing the 
program can be easily inferred to by a skilled computer programmer in the art. 
Also, the program can be stored in computer readable media, read and 
executed by a computer, and it can thereby realize the color image processing 
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method. The media can include magnetic media, optical media, and carrier 
waves. 

As described above, according to the present invention, a color image 
can be automatically segmented without user's assistance and is robust with 
5 respect to an input image containing noise. 

Industrial Applicability 

In the above color image segmentation method according to the present 
invention, a robust segmentation is possible even when segmenting an image 
10 containing much noise or texture. Furthermore, an automatic segmentation 
is possible without user's assistance such as segmentation performed 
manually by a user, therefore, the segmentation speed is high. The color 
image segmentation method can be applied to object-based image processing 
such as that used in MPEG-7. 

15 
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What is claimed is: 

1. A color image segmentation method for segmenting a color 
image into a plurality of regions, comprising the steps of : 

(a) calculating a predetermined value representing the degree of 
s difference from the color of peripheral pixels by using pixel values of an input 

image; 

(b) obtaining a converted image by converting a calculated value into 
a value of a predetermined scale; and 

(c) segmenting the converted image. 

10 

2. The color image segmentation method according to claim 1, 
wherein the step (c) segments the converted image based on a region growing 
method. 

is 3. The color image segmentation method according to at least one 

of claim 1 or claim 2, prior to the step (a), further comprising the step of (p-a) 
quantizing pixel values of an image into a predetermined number of 
representative pixel values; wherein the pixel values are quantized pixel 
values. 

20 

4. The color image segmentation method according to claim 3, 
wherein the representative pixel values consist of 10-20 values. 

5. The color image segmentation method according to at least one 
25 of claim 1 or claim 2 or claim 4, prior to the step (a), further comprising the 

steps of: 

(p-a-1 ) defining a predetermined window containing a center pixel; and 
(p-a-2) calculating a predetermined value representing the degree of 
difference from the color of peripheral pixels with respect to pixels in a defined 
30 window. 
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6. The color image segmentation method according to claim 3, prior 
to the step (a), further comprising the steps of: 

(p-a-1 ) defining a predetermined window containing a center pixel; and 
(p-a-2) calculating a predetermined value representing the degree of 
5 difference from the color of peripheral pixels with respect to pixels in a defined 
window. 

7. The color image segmentation method according to at least one 
of claim 1 or claim 2, wherein the step (a) comprises the steps of: 

10 (a-1 ) defining a window B which is centered at a pixel p and has a size 

of d x d when d is a positive integer; and 

(a-2) classifying a pixel position Z, into a C number of classes when i 
is a number between 1 and C, and Z, is a set of all pixels in the window B; and 

(a-3) obtaining a J-value with respect to each pixel in a class-map as: 

15 

j _ ^ B _ ^ T Z §K 

Syr 

where m, is the average of positions of N f data points in class Z h 
S T = Ilk-mil 2 and S w = t S* - I lh «/f • 

8. The color image segmentation method according to claim 3, 
20 wherein the step (a) comprises the steps of: 

(a-1 ) defining a window B which is centered at a pixel p and has a size 
of d x d when d is a positive integer; and 

(a-2) classifying a pixel position Z t into a C number of classes when i 
is a number between 1 and C, and Z, is a set of all pixels in the window B; and 
25 (a-3) obtaining a J-value with respect to each pixel in a class-map as: 
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where is the average of positions of /V, data points in class Z„ 
S T = I«r- mf and S w = f S, = £ 1» - m.f . 

9. The color image segmentation method according to claim 4, 
5 wherein the step (a) comprises the steps of: 

(a-1 ) defining a window B which is centered at a pixel p and has a size 
of d x d when d is a positive integer; and 

(a-2) classifying a pixel position Z, into a C number of classes when i 
is a number between 1 and C, and z; is a set of all the pixels in the window B; 
10 and 

(a-3) obtaining a J-value with respect to each pixel in a class-map as: 

j _ §_B _ §T Z §E 

where m f is the average of positions of A/, data points in class Z /( 
is S T = 2 Ik - ™f and S lv = 1^ = 1 ||z - ^|| 2 . 

10. The color image segmentation method according to claim 5, 
wherein the step (a) comprises the steps of: 

(a-1 ) defining a window B which is centered at a pixel p and has a size 
of d x d when d is a positive integer; and 
20 (a-2) classifying a pixel position Z, into a C number of classes when i 

is a number between 1 and C, and Z, is a set of all pixels in the window B; and 

(a-3) obtaining a J-value with respect to each pixel in a class-map as: 
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j _ S_B_ _ §t 



where m { is the average of positions of /V, data points in class Z h 

c 

S r = Y,b-r4 2 and S tt , = £ S, = £ ||r- . 

11. The color image segmentation method according to claim 6, 
5 wherein the step (a) comprises the steps of: 

(a-1 ) defining a window B which is centered at a pixel p and has a size 
of d x d when d is a positive integer; and 

(a-2) classifying a pixel position Z, into a C number of classes when i 
is a number between 1 and C, and Z, is a set of all pixels in the window B; and 
10 (a-3) obtaining a J-value with respect to each pixel in a class-map as: 



j _ _ $t 



where m, is the average of positions of number of data points of class Z„ 

c 

S T = J^Wz-mf and S„ = I S, = I \\z- m,\\ . 

zeZ * eZ i 



15 12. The color image segmentation method according to claim 7, 

wherein the d is an integer inclusive of and between 3 and 10. 

13. The color image segmentation method according to claim 8, 
wherein the d is an integer inclusive of and between 3 and 10. 

20 

14. The color image segmentation method according to claim 9, 
wherein the d is an integer inclusive of and between 3 and 10. 



15. 



The color image segmentation method according to claim 10, 
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wherein the d is an integer inclusive of and between 3 and 10. 

16. The color image segmentation method according to claim 11, 
wherein the d is an integer inclusive of and between 3 and 10. 

5 

1 7. The color image segmentation method according to at least one 
of claim 1 or claim 2, wherein the predetermined scale is a gray scale having 
values between 0 and 255. 

io 18. The color image segmentation method according to claim 3, 

wherein the predetermined scale is a gray scale having values between 0 and 
255. 

19. The color image segmentation method according to claim 4, 
15 wherein the predetermined scale is a gray scale having values between 0 and 

255. 

20. The color image segmentation method according to claim 5, 
wherein the predetermined scale is a gray scale having values between 0 and 

20 255. 

21. The color image segmentation method according to claim 6, 
wherein the predetermined scale is a gray scale having values between 0 and 

255. 

25 

22. The color image segmentation method according to claim 7, 
wherein the predetermined scale is a gray scale having values between 0 and 

255. 

30 23. The color image segmentation method according to claim 8, 

wherein the predetermined scale is a gray scale having values between 0 and 
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255. 

24. The color image segmentation method according to claim 9, 
wherein the predetermined scale is a gray scale having values between 0 and 

s 255. 

25. The color image segmentation method according to claim 10, 
wherein the predetermined scale is a gray scale having values between 0 and 
255. 

10 

26. The color image segmentation method according to claim 1 1 , 
wherein the predetermined scale is a gray scale having values between 0 and 
255. 

15 27. The color image segmentation method according to claim 12, 

wherein the predetermined scale is a gray scale having values between 0 and 
255. 

28. The color image segmentation method according to claim 13, 
20 wherein the predetermined scale is a gray scale having values between 0 and 

255. 

29. The color image segmentation method according to claim 14, 
wherein the predetermined scale is a gray scale having values between 0 and 
255. 

25 

30. The color image segmentation method according to claim 15, 
wherein the predetermined scale is a gray scale having values between 0 and 

255. 

30 31. The color image segmentation method according to claim 16, 

wherein the predetermined scale is a gray scale having values between 0 and 
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255. 

32. An object-based color image processing method for processing 
a color image according to a color image segmentation method, wherein the 

5 color image segmentation method comprises the steps of: 

(a) calculating a predetermined value representing the degree of 
difference from the color of peripheral pixels using pixel values of an input 
image; 

(b) obtaining a converted image by converting a calculated value into 
10 a value of a predetermined scale; and 

(c) segmenting the converted image. 

33. The color image processing method according to claim 32, 
wherein the color image processing method complies with the MPEG-7 

15 standard. 

34. A color image segmentation method for segmenting a color 
image into a plurality of regions, comprising the steps of: 

(a) quantizing pixel values of an image into a predetermined number of 
20 representative pixel values; 

(b) calculating a predetermined value representing the degree of 
difference from the color of pixels in a predetermined size window using 
quantized representative pixel values; 

(c) obtaining a converted image by converting a calculated value into 
25 a value of a predetermined scale; and 

(d) segmenting the converted image using a segmentation method 
based on a region growing method. 

35. The color image segmentation method according to claim 34, 
30 wherein the step (a) comprises the steps of: 

(a-1 ) defining a window B which is centered at a pixel p and has a size 
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of d x d when d is a positive integer; and 

(a-2) classifying a pixel position Z/ into a C number of classes when i 
is a number between 1 and C t and Z; is a set of all pixels in the window B; and 

(a-3) obtaining a J-value with respect to each pixel in a class-map as: 

5 

S w 

where m, ;U the average of positions of N } data points in class Z h 
S T = Ilk- mf and S m = f S, = I \\z- mf . 

36. The color image segmentation method according to claim 35, 
10 wherein d is an integer inclusive of between 3 and 1 0. 

37. The color image segmentation method according to one of claim 
34 to claim 36, wherein the predetermined scale is a gray scale having values 
between 0 and 255. 

15 

38. A medium for storing program codes performing a color image 
segmentation method for segmenting a color image into a plurality of regions, 
wherein the color image segmentation method comprises the steps of: 

(a) quantizing pixel values of an image into a predetermined number of 
20 representative pixel values; 

(b) calculating a predetermined value representing the degree of 
difference from the color of pixels in a predetermined size window using 
quantized representative pixel values; 

(c) obtaining a converted image by converting a calculated value into 
25 a value of a predetermined scale; and 

(d) segmenting the converted image using a segmentation method 
based on a region growing method. 
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39. The medium according to claim 38, wherein the step (a) 
comprises the steps of: 

(a-1 ) defining a window B which is centered at a pixel p and has a size 
of d x d when d is a positive integer; and 
s (a-2) classifying a pixel position Z, into a C number of classes when i 

is a number between 1 and C, and Z, is a set of all pixels in the window B; and 

(a-3) obtaining a J-value with respect to each pixel in a class-map as: 

j = - — - — 

S lv 5 (r 

10 where m, is the average of positions of A/, data points in class Z h 
S T = 2 U - ™t and S„. = f S, - I |r - m, f 

40. The medium according to claim 39, wherein d is set as an integer 
inclusive of and between 3 and 10. 

is 41 . The medium according to one of claim 38 to claim 40, wherein 

the predetermined scale is a gray scale having values between 0 and 255. 
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